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Abstract — While some write once memory (WOM) codes are 
inherently decodable, others require the added knowledge of the 
current generation in order to successfully decode the state of 
the memory. If there is no limit on the code length, n, a binary 
non-decodable i-write WOM code can be made decodable at an 
insignificant cost in terms of code rate by adding t — 1 cells to 
store the current generation after replicating the code enough 
times for the t — 1 cells to be of negligible weight. This justifies 
the research on non-decodable WOM codes. However, if n is 
bounded, the t — 1 additional cells may introduce a significant 
loss in terms of code rate. In this paper, we propose a new method 
to make non-decodable WOM codes decodable at a lower price 
when n is bounded. The main idea is to add cells that do not 
only store the current generation, but also additional data, by 
using a synchronous (t — 1) -write WOM code of length t — 1 
or slightly above which does not contain the all-zero codeword. 
A bound on the rate of a simple family of synchronous WOM 
codes with n = t is given, as well as very short codes from this 
family. Better codes are then obtained by local manipulations of 
these codes. Finally, a construction of synchronous WOM codes 
with good properties is proposed to reach higher values of t. 

I. Introduction and Definitions 

A write once memory (WOM) (T| is a storage device 
consisting of memory cells that take on q > 2 possible states in 
{0, . . . , q— 1}, and such that the state of a given cell cannot be 
decreased. The main problem in the WOM model is to know 
how much information can be stored into n q-ary memory 
cells using t writes (also called generations), starting from 
the all-zero state. Formally, we are looking for i-write WOM 
codes, which are codes designed to store and update data in 
the WOMs using t writes. WOM codes are defined by their 
t encoding and decoding maps. The following definition is 
taken from 0: 

Definition 1: An [n,t : Mi,...,M t ] i-write g-ary WOM 
code C is a coding scheme for n q-ary WOM cells, which 
consists of t pairs of encoding and decoding maps £ j and T>i 
(1 < i < t) such that: 

1) £ 1 :{l > ...,Mi}->{0 > ...,?-l} w . 

2) For 2 < i < t: 

. £, : {l,...,Mi} x Iro(£i_i) -)• {0, . . . , q - 1}", 
. V(ro I c)e{l,... J M i }xIm(£j_i), 
Vj G {l,...,n}, (£i(m,c)) } > {c) 3 . 
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3) For 1 < i < t, Vi : {0,...,q - l} n -»• {1, . . . ,MJ, 
and 

. VmG {l,...,Mi}, V x (£ 1 {m)) = m, 
. for 2 < i < t, V(m, c) G {1, . . . , M,} x Jm(£,-_i), 
T>i(£i(m, c)) = m. 
For simplicity, in the remainder of the paper, we will refer 
to WOM codes simply as codes. The rate of the above code, 
referred to as the WOM-rate, is defined as follows (0: 

Definition 2: The rate of generation i G {1, . . . ,t} of an 
[n, t : M±, . . . , M t ] q-ary code C is 



A log. Mi 



TZi(C) = 

11 

and the WOM-rate of C is defined as 



rc(co = X>(C) 



Eli log, M 4 



(1) 



(2) 



i=l 



Given t, q and sometimes n, one would like to maximize the 
WOM-rate. In this paper, we only consider binary codes, i.e., 
q = 2. 

Depending on the structure of the code, the state of the cells 
may or may not suffice to determine the current generation 
(i.e., how many times the block has been written, and which 
map T>i should be used to decode). In other words, the code 
is not always decodable. We call decodable codes the codes 
such that for any state of the cells c and any i\ and 12 with 
c G Im^ii) n Im(£i 2 ), 2?i!(c) = X>j 2 (c). A code is called 
synchronous 0] if a given state of the cells can only be reached 
at a given generation, i.e., the sets Im(£i) are disjoint for 
1 < i < t. A simple way to guarantee that a code is syn- 
chronous is to force the Hamming weight w of the cells to be 
an injective function of the generation, i.e., for Ci G Im(£i 1 ) 
and c 2 € Im(£i 2 ), w(c\) = w(c 2 ) => i\ = %2- These codes 
are called laminar in HI. By construction, synchronous codes 
are decodable. A construction of synchronous (and laminar) 
codes was given in JT) for n = t being a power of two, and 
WOM-rate log 2 (i)/2. However, synchronous codes have not 
been extensively studied. Non-synchronous codes can still be 
directly decoded if, when the decoder cannot determine the 
current generation, the choice of Vi has no impact on the 
decoded symbol. Notice that synchronous codes are decodable, 
but the reverse does not always hold. For later use, if an [n, t : 



Mi,...,M t ] code is synchronous (respectively decodable), 
we will use the superscript "sync", [n,t : Mi, . . . , M t ] sync 
(respectively "dec", [n, t : Mi, . . . , M t ] dec ). Also, the binary 
cells that can be written from to 1 but not from 1 to are 
called wits (TJ. 

A non-decodable code C with parameters [n,t : 
Mi, . . . , M t ] can be turned into a decodable (and even syn- 
chronous) code by simply concatenating k instances of C with 
a block of t — 1 cells that stores the current generation (by 
being filled one by one at each write, starting at the second 
generation). The resulting code is a synchronous code with 
parameters [kn + t — 1, t : M\ , . . . , M t ]. Note that if fc goes 
to infinity, the WOM-rate of this code goes to the WOM-rate 
of the original code C, 1Z(C). A common approach in the 
literature is to design codes that approach the boundaries of 
the capacity region (see, e.g., Q, (0), and then make them 
decodable using this method. Therefore, most of the state-of- 
the-art high-rate codes are not directly decodable. However, 
if the target application specifies t and n, making a non- 
decodable code decodable using the above-mentioned method 
can significantly degrade its WOM-rate. For instance, consider 
n = 6 and t = 4, and assume that we do not know a decodable 
code of length 6. In this case, we could select a non-decodable 
4-write code of length 3, and append 3 cells to store the current 
generation. The resulting WOM-rate is half the original one, 
as the additional cells only carry information about the current 
generation. 

Notice that if the system must be able to know, when the 
state of the memory is the all-zero vector, whether this is 
because the block is empty or because it contains the all- 
zero codeword, then adding t — 1 cells is not enough to 
make the code decodable, but t cells are required in this case, 
instead. Here we consider the case where t — 1 additional cells 
are enough. The analysis for the other scenario is extremely 
similar. 

In this paper, we propose a different approach to make 
a non-decodable i-write code C decodable. The key idea 
is to append t — 1 additional cells which store not only 
the current generation but also new data, by using a i-write 
synchronous code with length t — 1, and writing generations 
of C and of the synchronous code simultaneously. In the 
scenario where the system must know the difference between 
the all-zero codeword and an empty block of memory, a t- 
write synchronous code of length t which does not contain 
the all-zero codeword would be required. To unify the search 
for codes for both scenarios, we search for codes with n = t 
which do not contain the all-zero codeword, and we turn 
them into a code suited for the scenario where the distinction 
between the all-zero codeword and an empty block is not 
required, by adding a generation that only contains the all- 
zero codeword. Then, synchronousness guarantees that by 
observing the t— 1 new cells, the decoder can always determine 
the current generation, and use this knowledge to decode the 
obtained code. We also consider using i-write synchronous 
codes with length slightly above t—1 (the length should remain 
small, because we do not expect to find synchronous codes of 



WOM-rate higher than non-decodable ones, thus the highest 
number of cells should be reserved to the non-decodable code). 
In particular, our focus is on binary laminar codes, but the 
proposed approach can be extended to non-laminar codes and 
non-binary codes. 

II. Laminar WOM Codes with n = t 

In this section, we focus on building laminar codes with 
n = t, that write exactly 1 wit at each generation. Also, 
in order to simplify the problem, we try to maximize the 
values of M, generation by generation, rather than globally 
maximizing the WOM-rate. Consider a code C with n = t that 
writes exactly 1 wit per generation, and a generation i > 1. 
Assuming that the previous generations are already fixed, the 
condition we have on Mj is that for every x G 7m(£j_i), 
and for every m G {1, . . . , Mj}, there exists y G Im(£i) such 
that x < y and T>i(y) = m (where x < y if Xk < Uk f° r 
all k, 1 < k < n). Denote by E™ the set of binary vectors 
of length n and Hamming weight i. It follows that at each 
generation i, Im(£i) C Ef. We use this set inclusion to make 
our maximization at each generation completely independent 
from the other generations, at the cost of optimality. 

Let us define the equivalence relation =" on Im(£i) by 
y =" y' if and only if £>.;(y) = Dj(y'). Let us refer to the 
equivalence classes of this relation as the codeword classes of 
C at generation i. Codeword classes are subsets Y C E™ for 
which, if we do not take the previous generations into account, 
the following must hold: 

VxeKI 1 -:, 3y £F : x < y. (3) 

We are also interested in the partitions of Ef as a set of 
valid codeword classes. If y denotes such a partition, we want 
that 

VF G y, Vx G £f_i, 3y G Y : x < y. (4) 

Each valid partition y corresponds to a valid decoding map 
(modulo reordering), and thus each cardinality |3^| to a valid 
Mj. We are therefore interested in finding the maximum 
cardinality, denoted by Aj(n), of such a partition. We give 
an upper bound on Aj(n): 

Proposition 1: Let Bi{n) be defined by 

Bi(n)± . (5) 

mm Y 

_ Y s.t. holds 

Then, the maximum cardinality Ai(n) of a partition y that 
satisfies © is upper bounded by A;(n) < Bi(n). 
Proof: Let 3^ be any partition of E™. Then, 

^•(, s . t ^J y i)^Ei F i = i^i = (-)- ® 

This holds in particular when y is of maximum cardinality. 

□ 

This bound can be computed using a computer search for 
the smallest Y that satisfies ([3]). The search is relatively slow, 
but notice that by lower-bounding | Y \ by ^'"^ (each element 



TABLE I 

Upper bound Bi(n) on Ai(n). Values in bold are constructive, and are such that Ai(n) = Bi(n). 
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y G E™ covers exactly i elements x <G E^_i), we obtain a 
closed-form bound: 



(?) 
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While the closed-form bound can be computed efficiently 
and is reached for some values of (n, i) (for instance, for 
n < 3, or for i < 2, or i = n), even for relatively low 
values of n and i, it can be strictly higher than Ai(ri). 
For instance, A 3 (4) = 1, while the closed-form bound 
is 2. Indeed, E$ = {1110,1101,1011,0111} and E% = 
{1100, 1010, 1001, 0110, 0101, 0011}, and while each element 
of E% covers 3 elements of E\, it is not possible to pick two 
elements of E\ that cover distinct elements of E%- Therefore, 
the codeword classes in E$ have cardinality at least 3, and not 



A. Comparison with a Computer Search for Small n 

For very small values of n, the exact value of Ai (n) can be 
computed by conducting a simple exhaustive search on the set 
of codeword classes. Values of B^n) are also obtained with 
an exhaustive search, but on the minimum size of codeword 
classes, which is significantly faster. The results of the two 
searches are reported for n < 16 in Table J] The values in 
bold font are Ai(n), the others are S,(n). The few values 
of Ai(n) that were computed exactly match Bi(n), so it is 
unknown whether there are pairs (n,i) such that A%{ri) < 
Bi(n). Note that these values are constructive. For instance, a 
[4, 4 : 4, 3, 1, l] sync and a [5, 5 : 5, 3, 2, 1, l] sync code can be 
obtained from the search. 

III. Laminar WOM Codes with n > t 

The constraints that we applied on the codes of Section [II] 
especially the constraint that n = t, keep the code WOM- 
rates relatively low. Lifting the constraint on n = t allows 
for higher WOM-rates, and laminar codes with n slightly 
larger than t can easily be derived from codes obtained as 



in Section |n] by merging several generations together: taking, 
as the new set of codeword classes, the union of the sets 
of codeword classes of two or more consecutive generations. 
For instance, the [4,4 : 4,3, l,l] sync code can be turned 
into a [4, 3 : 4, 3, 2] sync code by merging its third and 
fourth generations together. Instead of having one codeword 
class at generation 3 ({1110,1101,1011,0111}) and one at 
generation 4 ({1111}), now the third generation has two 
codeword classes: {1110, 1101, 1011, 0111} and {1111}, and 
there is no fourth generation anymore. Likewise, a [5,3 : 
5,3,4] sync code (of WOM-rate 1.181) can be derived from 
the [5,5 : 5, 3, 2, 1, l] sync code by merging the last three 
generations together. However, consider the codeword classes 
of vectors of weight 4. These were constructed in order to 
cover every word of weight 3, while they now only have to 
cover every word of weight 2. The optimization also did not 
allow codeword classes of mixed weights. We can reorganize 
the set of vectors of weight 3 or more into a better balanced 
set of codeword classes. In ©, we give the codeword classes 
of the third generation of a [5, 3 : 5, 3, 6] sync code (of WOM- 
rate 1.298) obtained by reorganizing the third generation of 
the [5,3 : 5,3,4] sync code: 

{01111, 11001, 10110}, {10111, 11100, 01011}, 
{11011,01110,10101}, {11101,00111,11010}, 
{11110,10011,01101}, {11111}. (8) 

For comparison, the 4 codeword classes of the third gener- 
ation of the [5,3 : 5,3, 4] sync code are: 

{11100,11010,10101,01011,00111} (weight 3 only), 
{11001,10110,10011,01110,01101} (weight 3 only), 
{11110, 11101, 11011, 10111, 01111} (weight 4 only), 
{11111} (weight 5). (9) 

Other choices can be made regarding which generations to 
merge to obtain a 3-write code from the [5, 5:5,3, 2, 1, l] sync 
code, but lower WOM-rates are obtained. 



IV. A Construction for Synchronous WOM Codes 
of Higher t 



TABLE II 

Rates of decodable codes obtained by concatenating 
synchronous codes, with target code length n = 64. 



We propose a construction to obtain synchronous codes 
for higher values of t by concatenating n' instances of a 
synchronous code of length n, and using a second synchronous 
code of length n! to decide, at each generation, which of the 
n! instances of the first code are going to be modified. 

Theorem 1: Let C be an [n, t : Mi, . . . , M t ] synchronous 
code of WOM-rate R, and C an [n',f : M[,...,M' t ,] 
synchronous code of WOM-rate R' . Then there exists an 
[nn',W : M X M[, . . . , M x M' t ,, . . . , M t M{, . . . , M t M[\ syn- 
chronous code d of WOM-rate Ri = 4i? + -R' '■ 

A formal proof is omitted here, and we only give the idea of 
how the construction works. We first consider only the case 
where n' = t' (in which C writes exactly one wit at each 
generation). The key idea is that the nn 1 wits of C\ are divided 
into n' blocks of n wits, and the tt' generations are divided 
into t stages of t' generations. In the first stage, during each 
of the first t' generations we use the encoding function of the 
first generation of C to write in exactly one empty block of n 
cells. C tells us which of the n' blocks is going to be written: 
it writes exactly one wit among n' per generation, which we 
map to one block among the n' blocks at each generation. 
After this first stage, each block contains a codeword of the 
first generation of C. During the second stage, we use the 
encoding function of the second generation of C, and C once 
again points to the block that will be written. This process is 
repeated for all t stages. Thus, during the l-th generation of 
the p-th stage (1 < p < t, 1 < I < t'), we pick messages in 
{1, . . . , M p x M/}, and each message mi can be mapped to 
a pair of messages (m, m!) 6 {1, . . . , M p } x {1, . . . , M/}. 

From the decoder perspective, at all times, either every 
block has codewords of the same generation p of C, or there 
are blocks at generation p and blocks at generation p — 1. 
Because C is synchronous, the decoder has knowledge of the 
value of p (the current stage). Let c' = (c[, . . . ,c' n ,) where - 
c' k = if the fc-th block is at generation p—1 and c' k = 1 if 
the fc-th block is at generation p. The decoder knows c' and 
therefore m! . However, it does not have knowledge of which 
block of wits was written last. Therefore, we do not directly 
encode m in the block that is written: instead, we encode a 
message mo such that by decoding every block of wits at 
generation p using C, and then taking the modulo M p sum of 
the decoded messages in {1, . . . , M p }, we recover m. mo is 
(modulo M p ) m minus the sum of the decoded messages of 
all the blocks at generation p (the encoder must therefore be 
able to decode C). 

Now, if n! ^ t', C may write several wits during some 
generations. When this happens, the encoder of C\ writes in 
every block pointed at by C , once again so that the modulo 
M p sum of the decoded messages is m. Here, there are more 
degrees of freedom than in the case n' = t' (in which mo was 
fully determined). A simple way to deterministically choose 
the values that we encode in each of the blocks that will be 
written is to encode M p in each block but the last, and then 
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Rate of non-dec. 


Rate of dec. 


With data 






code from |4) 


with no data 


Sync, code 


Rate 


4 


1.8564 


1.7694 


[3,3 : 3,1, IJ 
[5,3 : 5,3,6] 


1.7941 
1.8128 


5 


1.9664 


1.8435 


[4,4 : 4,3, 1, 1] 


1.8995 


6 


2.1297 


1.9633 


[5,5 : 5,3,2,1,1] 


2.0400 


7 


2.1697 


1.9663 


[6,6 : 6,5,3,1,1,1] 
[8,6 : 8,4,6,3,4,2] 


2.0677 
2.0886 



TABLE III 

Rates of decodable codes obtained by concatenating 
synchronous codes, with target code length 71 = 256. 
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Rate of non-dec. 


Rate of dec. 
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code from (3) 


with no data 


Sync, code 


Rate 
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1.8564 
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[3,3 : 3, 1, IJ 
[5,3 : 5,3,6] 
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[4,4 : 4,3, 1, 1] 
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2.1297 


2.0881 


[5,5 : 5,3,2,1,1] 


2.1073 
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2.1697 


2.1188 


[6,6 : 6,5,3,1,1,1] 
[8,6 : 8,4,6,3,4,2] 


2.1442 
2.1494 



encode the same mo as in the case n' = t' (since adding M p 
has no effect modulo M p ), 

Let us now establish the WOM-rate R\ of C\. 



Ri = 
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= — 7 (t' -nR + t- n'R 1 ) = —R + -R'. 



A. Example 

Let C be the [4, 3 : 4, 3, 2] s y nc code defined by: 



(10) 





1 


2 


3 4 




{0001} 
{1100,0011} 
{0111,1011, 
1101,1110} 


{0010} 
{1010,0101} 

{1111} 


{0100} {1000} 
{1001,0110} 



Let C be the [2, 2 : 2, l] s y nc code defined by: 

1 2 



{01} {10} 

{11} - 

The code C\ obtained with the construction is a [8, 6 : 
8,4,6, 3,4, 2] sync code. Consider that the eight cells are in 
state (c l7 c 2 ) = (1100,0010). Let us first consider the decod- 
ing of the message. The generation in C of the first block Ci is 
2, and that of the second block c 2 is 1, thus p = 2 (the highest 
of the two) and c' = (10). The fact that C is synchronous 
guarantees that only one encoding function of C has c' in its 
range: here, it is the encoding function for 1 = 1. Thus, we are 
at the first generation (I = 1) of the second stage (p = 2), so 
the overall generation is i = (p—l)t' + l = (2 — 1) x 2 + 1 = 3. 



We have to' — 1?^ (10) = 2. m is the modulo M p sum of 
T^p{ck) for all indices k of a block at generation p of C. 
Here, there is only one block at generation p = 2 for C: 
block Ci = (1100), therefore m = 2?2(ci) (mod 3) = 1. The 
original message pair was therefore (1, 2). This can be mapped 
to ?ni 6 {1, . . . , Alp x A//} by 7711 = (m - 1)M/ + m', for 
instance, which gives 7771 = 0x2 + 2 = 2. 

Let us now encode a new message 777,1 = 2 G {1, 2, 3} for 
generation 4. Our new m and m' are 2 and 1, respectively, 
so that (m - 1)M/ + to' = (2 - 1) x 1 + 1 = 2. c' = (10) 
will become c' = (11) because f 2(1, 10) = (11). Therefore, 
the second block is going to be written (because the second 
wit of c' changes). We first decode all the blocks already at 
generation p = 2: here, we only have one block at generation 
p = 2, and T>2{c{) = £>2(H00) = 1. We therefore encode in 
the second block c 2 a message 7770 such that 1 + too = 777 
(mod M p ), where M p = M 2 = 3 and to = 2. Thus, mo = 1. 
c 2 is then replaced by £ p (l, 0010) = (0011). The state of the 
cells is (1100,0011) after this encoding phase. 

B. Results 

Let us denote by F(C,C) the code obtained by applying 
the construction of Theorem[TJto C and C. We can iterate the 
above construction by choosing C and C, and then defining 
Co = C and for all m > 0, C m = F(C m _i,C"). This 
generates codes with even higher values of t, which have to 
be compared with a construction of synchronous codes from 
ITJ (where 77 = t is any power of two and the WOM-rate is 
log 2 (f)/2). Notice that the two constructions happen to match 
when we take as C = C the trivial [2, 2 : 2, l] sync code. 

First, we restrict ourselves to codes with n = t (which are 
easier to compare) and we fix C = C. The WOM-rate of the 
i m -write code C m after m iterations of the construction is 

TZ(C m ) = m1l(C) = \og t (t m )TZ(C) = log 2 (t m ). 
Therefore, for codes with n = t, the higher 5 — ^4 is, the better 

& log 2 (t) 

this iterated construction works. The code that maximizes this 
ratio among those found by our computer search is the one 
with 77 = t = 2 (with ^ C ,\ = i), making the codes from 

v log 2 (f) 2-" & 

HI the best in terms of asymptotic WOM-rate until codes 

for higher values of 77 = t are found. For instance, Table J] 

suggests that a [8, 8 : 8, 7, 5, 5, 2, 2, 1, l] sync code could exist, 

with a ratio of 0.519 (and even better synchronous codes 

could exist even for 77 = t = 8, if we remove the added 

constraints from Section|n). However, when the code length is 

not a power of two, our construction yields codes with lengths 

of the form 2 a 3 fc 5 c by mixing different elementary codes of 

lengths 2, 3, and 5 as the C codes, instead of always using the 

length-2 code. This is a much denser coverage of the potential 

values of t. Furthermore, if we consider codes with 77 slightly 

greater than t, we can reach higher WOM-rates at equal values 

of t. Consider, for instance, the code F(C, C") with C the 

[4,3 : 4,3,2] sync code and C the [2,2 : 2, l] sync code. The 

construction then yields a [8,6 : 8, 4, 6, 3, 4, 2] sync code of 
WOM-rate 1.512 (larger than log 2 (t)/2 both for t = 6 and 

t = 8). This is the example code of Section IIV-AI 



V. Results 

We compare our method of making WOM codes decodable 
with the method that adds t — 1 data-less cells. For this 
comparison, we consider two different target code lengths: 
77 = 64 and 77 = 256. We then assume, for each value of 
77 and for t between 4 and 7, that there is a code with WOM- 
rate equal to the best currently known WOM-rate for i-write 
codes (from J4]), and with length 77 minus the length of the 
synchronous code that we concatenate to it. We do not use the 
actual code lengths at which these state-of-the-art WOM-rates 
are reached because they are very large |]5]- 

The results are reported in Tables |TT] and [HI] The second 
column of each table reports the state-of-the-art WOM-rate of 
non-decodable codes, for each value of t. The third column 
shows the WOM-rate that would be obtained by appending 
t — 1 data-less cells to a code of length 77 — t + 1 and WOM- 
rate equal to the one reported in the second column. The 
last two columns show, for various synchronous codes, the 
WOM-rate that we obtain for the same target length. The 
[3,3 : 3, l,l] sync , [4,4 : 4, 3, 1, l] sync , [5,5 : 5, 3, 2, 1, l] sync , 
and [6,6 : 6, 5, 3, 1, 1, l] sync codes are from Section M the 
[5, 3:5,3, 6] sync code is from Section |m] and the [8, 6 : 
8, 4, 6, 3, 4, 2] sync code is from the construction of Section [TVl 
Note that our technique yields higher WOM-rates compared to 
just appending a block of t — 1 cells with no information, for 
both target lengths. These WOM-rates are (to the best of our 
knowledge) also higher than the best WOM-rates for binary 
multiple-write codes (and hence better than the rates of any 
directly decodable code) known prior to [4|, which justifies 
our approach. 

VI. Conclusion 

In this paper, we proposed short synchronous WOM codes 
as a basic tool to make non-decodable WOM codes decodable 
while preserving the WOM-rate as much as possible. We 
derived bounds for a simple family of short synchronous 
WOM codes, and constructed some synchronous WOM codes 
for small values of t. Furthermore, we proposed a construction 
method to build synchronous WOM codes for higher values of 
t obtained by concatenating shorter synchronous WOM codes. 
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